A usability case study using TREC and ZPRISE
نویسندگان
چکیده
This paper examines the challenges involved in conducting an informal usability case study based on the introduction of a new information retrieval system to experienced users. We present a summary of activities performed during two iterations of usability testing and describe our analysis methodology. This methodology incorporates several grouping and prioritizing methods which provide one of the major contributions of the work. During the course of the case study, we learned some valuable lessons which were specific to the Text REtrieval Conference (TREC). The TREC-specific lessons learned led to recommendations for changes in the TREC topic development and assessment tasks. Results of the study include lessons learned about both the users and the testing techniques (Hoffman & Downey, 1997). A Usability Case Study Using TREC and ZPRISE Laura L. Downey, Dawn M. Tice National Institute of Standards and Technology, Gaithersburg, Maryland 20899, U.S.A.
منابع مشابه
Rutgers' TREC-6 Interactive Track Experience
The goal of the Rutgers TREC-6 Interactive Track study was to compare the performance and usability of a system offering positive relevance feedback with one offering positive and negative relevance feedback. Our hypothesis was that the latter system would better support the aspect identification task than the former. Although aspectual recall was higher for the system supporting both kinds of ...
متن کاملBerkeley's TREC 8 Interactive Track Entry: Cheshire II and Zprise
This paper briefly discusses the UC Berkeley entry in the TREC8 Interactive Track. In this year’s study twelve searchers conducted six searches each, half on the Cheshire II system and the other half on the Zprise system, for a total of 72 searches. Questionnaires were administered to each participant to gather information about basic demographic and searching experience, about each search, abo...
متن کاملA Comparison of Boolean and Natural Language Searching for the TREC-6 Interactive Task
The TREC-6 interactive task used a multi-site experimental protocol, where each participating site compared an “experimental” system with a common “control” system used at all sites. For the Oregon Health Sciences University site, the “experimental” system was a Boolean interface to the MG system, while the control system was, as for all sites, the natural language ZPRISE system. Performance wa...
متن کاملTREC interactive with Cheshire II
This paper describes the UC Berkeley's participation in the TREC-6, 7 and 8 interactive track experiments. In these three studies 24 searchers (four in TREC-6, eight in TREC-7, and 12 in TREC-8) conducted a total of 160 searches, half on the Cheshire II system and the other half on the ZPRISE system. In TREC-7 and TREC-8 questionnaires were administered to gather information about basic demogra...
متن کاملManual Queries and Machine Translation in Cross-Language Retrieval and Interactive Retrieval with Cheshire II at TREC-7
For TREC-7, the Berkeley ad-hoc experiments explored more phrase discovery in topics and documents. We utilized Boolean retrieval combined with probabilistic ranking for 17 topics in ad-hoc manual entry. Our cross-language experiments tested 3 di erent widely available machine translation software packages. For language pairs (e.g. German to French) for which no direct machine translation was a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Inf. Process. Manage.
دوره 35 شماره
صفحات -
تاریخ انتشار 1999